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ABSTRACT _ - 

The study investigated the effects of exposure to 
computer- assisted testing (CAT) as an effective instructional method 
and its effect,s on attitudes toward computer-assisted instruction 
(CAI) • Five computer quizzes- consisting of 20. randomly drawn 
multiple-choice quQ^tions were individually^ .ajtministered on -10 
teletype terminals A feedback igechanism was incorporated in the CAT 
program and provided detailed explanations of questions. Results 
indicated that subjects ex^os^d to CAT had significantly mo5;e 
favorable attitudes toward CAI than subjects not exposed to CAI. Ii^- 
addition, CAT was perceived, by students to be an effective 
instructional method in aiding mastery of conceptual and factual 
material. (Author) ' • * ' 
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. ABSTRACT - 

The study investigated the effects of exposure to cpmputer-asslsted testing 
(CAT) as an effective instructional .method and its effects on attitudes toward 
computer-assisted instruction (CAI) . Five computer quizzes consisting of tw/^ty 
randomly di:^wn multiple-rchoice questions were individually administered or/ten 
teletype^ tennlnals, A feedback mechanism was incorporated in the CAT program 
and provided detailed explanations of questions. Results indicated tfnat Ss ex- 
posed to CAT had significantly more favc^urable attitudes toward CAT than Ss not 
' * ' / 

exposed ±o CAI. 'In addition,- CAT was perceived by students to^be an effective 

' / " * / 

instructional method in aiding ma^^ery of conceptual and factual material. 
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Educators ^nd psychologists have become increasingly aware of the psycho- 
Icgical and sociological problems inherent iil the typical classroom approaches 
to learning of which evaluation forms an integral part*. The constructign of 
achievement examination^ ik a task Tiiany instructors find difficult and which 
requires a considerable amount of time and energy. 

In recent years, computers 'have been used to generate exaijjinStions for 
traditional courses (Ansfield, 1973 Bi^owa, r973; Dudley, 1973), and for student- 

V' 

pac^d courses (Cohen & Cohen, 1973). Theoretically, these tests should* provide 

the student with valuable information via the correct answers, yet the'use of 

the computer in providing diagnostic feedback on student examination results 

has been limited. Ansfield (1973) describes the Automated Examination Generator 
■* . * ° • 

(AEG) in use at the University of^j^sconsin at Oshkosh, .a program designed to 
generate examinations from an 'item bank, grade academic achievement, record each 

Student's performance,* and provide some individual comments designed to remedi- 

\ ^ . ' . ■ 

ate particular scholastic weaknesses. 

To achieve optimal learning however, it has been argued that an essential 
element, that of immediate knowledge of correct results (KCR) , is missing (c.f. 
Skinner, 1968).^ But most computer j^ft^rated examinations have as their primary 



a^ 



aorm evaluation. Computer constructed examinations can provide efficient, low 

, cost, qualit]^ procedures for repetitive evaluations of performance using equiv- 
, * ' ' V . . ' 

alent examination forms (Cartwright, 1975). Nevertheless, most attempts at 

^compute*: -assisted test construction (CATC) have centered on the production of 

pencil -and-paper varieties of' multiple-choice items which lack the piovlsipn for 

immediate feedback, and consequently for improved learnfng*' 

. • I • 

One of the reasons for the lack of immediate feedback on computer -construe ted 
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tegts ^is that although the test is generated and scqred by the computer, the . 
student has no actual contact with the machine, often resifl^'ing in relatively- 
long delays between the writing of the test and the return of the results. 

An alternative method of resolving this difficulty would be to allow the 

^ ' ' f 

computer. to actually^admihister the test and provide feedback, in process, on 

each test item as it is encountered. While this form of computer-assi^sted 

testing (cat) is more costly than CATC, there are positive advantages. In 

c 

addition to immediate feedback regarding the correct* response, elaborate feed- 
back paragraphs can be provided containing text page numbers for further study 
and ^xplanatic^ns as to why alternative responses were incorrect. * This- then 
constitutes a form of interactive coAiputer-assisted testing and in many ways 
resembles computer-assisted in§tru6tion (GAI) because of its provision for 




immecLiate feedoack. 

' ^- ^ 

Student attitudes toward specific methods af learning, including CAI, have 
beeny shown to be highly correlated with achievement (Bund^, 1968). Mathie, Smith 
and Hansen (1970) concluded that^exposure tt> CAI ptfeduced positive attitudes to- ' 
wards CAI ^s a learning method. In addition, -Goodman (1968) has suggested that 
attitudes towards CAI may be modified by particular ^programs and systems. 

Students often have particular attitudes toward certain instructional methods 
even- though they m^y never have experienced those methods. ^It is possible that 
these attitudes may be modified by exposure to other similar instructional 'systems. 
Thus, the present study ^tjtempted to ascertain the effect aSs^xposure to CAT on 

attitud-es towards CAI as well as assess, student perceptions as to its usefulness as 

-\ 

/ * . * 

an dn'struct.ional method. ^ ' * • 

f ^ METHOD 

Subjects ♦ . - . ^ . *f ' * 

} 

The subjects were 29 male and 95 f^toale students all having at leafet an 
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undergraduate degree with a mean chronological ^ge of 21.75 years/ enroJLled in 
a one year, elementary teacher education program at McGill UniversitV* Of th^ 
lg4 subjects, 51 majored in ea^ly childhood education (kindergarten through 
grade 3), 60 in later childhood education (grades 4 through 7), 9 In French as 



.a second language (kindergarten through grade ,7) and 4 in art education (kinder- 
garten through grade 7).*- / . 



Procedure 



, Studeixts were assigned to one of six sections of an introductory course in 
educational psychology at McGill University,. Although all subjects produced ,^ 
written assignments^ for course grades, subjects- in three sections were exposed 
to" CAT while subjects in the remaining three sec,tions were 'exposed to more tra-^ 
ditional types of , evaluations such as classroom iiuizsJes and. final examinations. 
Five hour-lbn'g cdmputer quizzes were designed and administered to students in the 
e:^^erimental group. Each quiz contained twenty multiple^choice -questions ran- 
domly selected for each student from a bank.jof items. The test items were keyed, 
to the course text (Biehler^^ i971') and were supplied by the, publisher . After 
each question, the ,student typed In a response and wa§ informed if his response was 
correct, or incorrect. In additien.»,^gt5ident&Ji^ the option of Requesting a feed- 
back paragraph. This feedback paragraph was a significant featute of the computer ^- 
quizzes and provided explanation^ giying the correct response, the reason it was " 
correct, the reasons alternatives were indorrebt^ and a page number in the course 



text for further reference.. The pasa criterion fpx each quiz was s.et at 70% and 

»t / - ^ \ f . ^ ^ ' ' 

students. who 'did not meet the criterion were requited to repeat the quiz. Quizzes , 

were administereji oh ten teletype Model 33 terminals. 

At thp end of the academic year, the Teaching~Methods .Questionnaire II 

(Car twright, 1973) was administered to.all s^udenta. This questionnaire is a* revision 
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of one developed by McLeish (1970) to which, were added revisions of items by 

■ * /' ' 

Foster (1970). The^ questionnaire .consists of five scales of ten items^each, 

designed t;o elicit attitudes tovards lectures, tutorials, seminars, ptogparamed \ 

^ . ' ' ' . ' ' ^ . ^ . ' ' /' 

instruction (PI), and computer-assisted instruction. Students were given a 

descriptive paragraph on each teaching method*, with items relating to it. They 

wer^ asked tovrate each item on a four point scale, ranging from strbngly agree 

to strongly disagree. The questionnaire* yields five scores, one for e^ach. of the 

teaching methods involved. In addition, biographical informat,ion and data on 

student's perceptions of CAT and computers in general were obtained from each 

student'. • * * ^ % 

« 

RESUMS ' • ' ^ 

Scores on the five scales of the Teaching Methods Questionnaire II were 
computed and t_ tests were performed to determine if differences in attitude ex- 
isted between the CAT and no^iiKIAT groups. 
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Insert Table 1 about her^ 



The- figures in Tayle»l st^gest that compared to the non-CAT group, the CAT 
groOp scored signif icafntly higher on, scale? measuring attitudes towards lectures, 
prcrgrammed ^instruction, and computer-assisted instruction. In addition, compared 
to the non-CAT '^roup, stujl^nts exposed to C5^T tended to perceive the computer 
(j^izzes as being more of a*^learning than an evaXu'ative experience (X^ - 4.78, 

- 1> £ ^.05) reported learning more from computer quizzes th4n traditional 
classroom examinations (x2 r 28.23, df = 1 £ COOl), and in. general^ tended to rat^ 
CAT- as being superior to traditional classroom exaijis (X^ - 6.29, df i; £^«05). 
These results were unrelated to' the age" or sex of the subjects.- 
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. A one-w^y analysis of variance however, (£(3, 120) m 3.99, £<.01) suggested 
that subjects' in ^the different 'teacher education programs differed in their att- 
itudes* toward ^e .compute^ quizzes. Further analysis revealed that students in 
programs leading "to teacher certification in early . childhoo4 education had sigr 
hificantly more positive a^ttitudes toward CAT than did students in later child- 
hood programs (Scheffe, £<.0l). - . . 



. , . . DISCUSSION 

] The fadt that studenbs exposed t6 computer-assisted testing showed signi- 
/ ' '-^ ' ' . . . - 

fitantly. higher attitudes towards both^CAI and PI supports Goodman^s (1968) con- 
j» ■ ' ^ ' . • 

tent ion that attitudes towards CAI may be modified by particular programs and 

systems^ and suggests that attitudes towards various learning methods may be 
generalized^ from experience with similar learning methods. It was expected that 
exposure, to computer-assisted testing would produce some shift in attitudes to- 
wards Ci^i and perha'ps PI, however it wafe not clear why attitudes towards lec-* 

tures yould also be positively affected. One possible explanation suggested by 

t 

an independent evaluation of the course (Barnett, 1974) is that the instructors 
^ho initiated the com;^uter quizzes were perceived by students to §e. better lec- 
turers and that this perception may have beea reflected in the responses on the 
lecture .-scale . * • \ * ' % 

^ * 'Th^,, students perception of the computer quizzes as a learning , rather than 
atL evaluative expedience lends support for the continued study of this type of 
com|)uter-'assisted testing as a learning method. Because of the interactive nature 
of the'prog^m, fcR, explanatory feedback paragraphs, and keyed text page number 
can all' be provided immediately after edch item. In addition to receivingl^l- 
uable infotmation on the required concepts, students ar.e continuously conscious 



of their progress during the test. Perhaps it. is for these reasons tTiat students 
^tended to report learning more from interactive computer-assisted testing and 

* » ♦ 

tended to rate it as superior to tijaditional classroom exams. ' 

. - f - ' 

Hie finding that participants in different teacher education programs held 
different attitudes towards CAI was^'not unexp|ec,ted though it was predicted that 
the effect would be in\he opposite direction. It was expected that students in , 
early ^childhood education who tend to be more humanistic and child-centered would 
see CAI as cold and dehumanizing, while those in later childho.od, who .dre subject- 
oriented would be more favorable to CAI. In addition, it was thought that later 
childhood students might perceive the more practical applications of computers in 
the classroom- The reverse was found tp be the case, and the Reasons for this 
remain unclear. Nevertheless, it is important to not'e that differences in atti- 
tude do exist among different program participants and this may be of interest to 
teacher educators. ^ ^ ^ ■ " 

While interactive computers-assisted testing remains a mor^e expensive form of 
testing, nuqiferous advantages become evident. The actual programming of test items 
is relatively simple since the structure of every item is basically the same as - 
every other item. Usually, the, task can be undertaken with a minimum of error by 
rela^tively -unsophisticated' student assistants. Unlike many other educational 
innovations, cojnputer-assisted testing is less threatening- in that it need not chang 

the role of the instructor and can often be introduced into conventional courses 
• iff 

with existing ctaff . From a learning poipt of view, the ability, to provide various . 
kinds of .immediate feedback in a testing situation would see^ to offer unique • 
possibilities for further research investigating the role of feedback in learning. 
It vould appear that the use of interactive computer-assisted testing represents a 
viable alternative to bo^th CATC and more traditional forms of classroom evaluation. 



. , Table 1 

Means and t Values for Differences in Student Exposure to Computer-Assisted Testing 



Sub'-scales of the Teaching 
Method Questionnaire II 


Means 
CAT . 


-Non-CAT 


1 

df 


• 

■ ^ 


* 


^ ♦ 
Lecture 


11.83 


10.08 


122 


2.1«K^ 




Tutorial 


16.01 


16.70 


122 


-1.24 




Seminar , 


'16.18 - 


17.02 


122 , 


-1.31 




Programmed Instruction 


14^24. 


12.79 . 


122 


2. -05 


■^.04 


uom^ucer Assistiea xns cruet ion- 

r 


1 




122 


2.^0 


.05 , 


* two tailed test 
\ 


c 








t 
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